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Abstract. Altenbernd, Thomas and Wohrle have considered acceptance of languages of infinite 
two-dimensional words (infinite pictures) by finite tiling systems, with usual acceptance conditions, 
such as the Biichi and Muller ones, in [ 1] . It was proved in 1 9 1 that it is undecidable whether a Biichi- 
recognizable language of infinite pictures is E-recognizable (respectively, A-recognizable). We show 
here that these two decision problems are actually Hj-complete, hence located at the second level 
of the analytical hierarchy, and "highly undecidable". We give the exact degree of numerous other 
undecidable problems for Biichi-recognizable languages of infinite pictures. In particular, the non- 
emptiness and the infiniteness problems are Sj-complete, and the universality problem, the inclusion 
problem, the equivalence problem, the determinizability problem, the complementability problem, 
are all Ilj-complete. It is also n2-complete to determine whether a given Biichi recognizable lan- 
guage of infinite pictures can be accepted row by row using an automaton model over ordinal words 
of length bJ^. 



Keywords: Languages of infinite pictures; recognizability by tiling systems; decision problems; 
highly undecidable problems; analytical hierarchy. 



1. Introduction 

Languages of infinite words accepted by finite automata were first studied by Buclii to prove the de- 
cidability of the monadic second order theory of one successor over the integers. Since then regular 
w-languages have been much studied and many applications have been found for specification and veri- 
fication of non-terminating systems, see |[24l|23l[T9l for many results and references. 



Address for correspondence: E Mail: 01ivier.Fink;el@ens-lyon.fr 



2 



Olivier FinkeU Highly Undecidable Problems about Recognizability by Tiling Systems 



In a recent paper, Altenbernd, Thomas and Wohrle have considered acceptance of languages of infinite 
two-dimensional words (infinite pictures) by finite tiling systems, with the usual acceptance conditions, 
such as the Biichi and Muller ones, firstly used for infinite words. This way they extended both the clas- 
sical theory of w-regular languages and the classical theory of recognizable languages of finite pictures, 
ifm . to the case of infinite pictures. 

Many classical decision problems are studied in formal language theory and in automata theory and arise 
now naturally about recognizable languages of infinite pictures. We proved in [9] that many decision 
problems for Biichi-recognizable languages of infinite pictures are undecidable. In particular, we showed, 
using topological arguments, that it is undecidable whether a Biichi-recognizable language of infinite 
pictures is E-recognizable (respectively, A-recognizable), giving the answer to two questions raised in 
[ij. We proved also several other undecidability results as the following ones: one cannot decide whether 
a Biichi-recognizable language of infinite pictures can be recognized by a deterministic Biichi or Muller 
tiling system, or whether it can be accepted row by row using an automaton model over ordinal words of 
length w^. 

Using the Ilg -completeness of the universality problem for cu-languages of non deterministic Turing 
machines which was proved by Castro and Cucker in 131, and some topological arguments, we show in 
this paper that the above decision problems are actually -complete, hence located at the second level 
of the analytical hierarchy, and "highly undecidable". Using other results of [3], we give also the exact 
degree of numerous other undecidable problems for Biichi-recognizable languages of infinite pictures. 
In particular, the non-emptiness and the infiniteness problems are Sj-complete, and the universality 
problem, the inclusion problem, the equivalence problem, the complementability problem, are all 112- 
complete. This gives new natural examples of decision problems located at the first or at the second level 
of the analytical hierarchy. We show also that topological properties of Biichi-recognizable languages of 
infinite pictures are highly undecidable. 

The paper is organized as follows. In Section 2 we recall definitions for pictures and tiling systems. 
The definition and properties of the analytical hierarchy are introduced in Section 3. We recall in Sec- 
tion 4 some notions of topology, including the definitions of Borel and analytic sets. We prove high 
undecidability results in Section 5. Concluding remarks are given in Section 6. 

2. Tiling Systems 

We assume the reader to be familiar with the theory of formal (u;)-languages |[24ll23l . We recall usual 
notations of formal language theory. 

When S is a finite alphabet, a non-empty finite word over S is any sequence x = a\ . . . a^, where G S 
for i = 1, . . . , A; , and k is an integer > 1. The length of x is k, denoted by The empty word has no 
letter and is denoted by A; its length is 0. S* is the set of finite words (including the empty word) over S. 
The. first infinite ordinal is uj. An uj-word over S is an u; -sequence ai . . . a„ . . ., where for all integers 
i > 1, Oj € S. When a is an oj-word over S, we write a = cj(l)o"(2) . . . a{n) . . ., where for all 
i, a{i) G S, and a[n] = a{l)a{2) . . . a{n) for all n > 1 and cr[0] = A. 

The usual concatenation product of two finite words u and v is denoted u.v (and sometimes just uv). 
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This product is extended to the product of a finite word u and an u-word v: the infinite word u.v is then 
the tj-word such that: 

{u.v){k) = u{k) if A; < \u\ , and {u.v){k) = v{k — \u\) ifk > \u\. 

The set of co-words over the alphabet S is denoted by S'^. An Lo-language over an alphabet S is a subset 
of S'^. 



We now define two-dimensional words, i.e. pictures. 

Let S be a finite alphabet and # be a letter not in S and let S = S U {#}. If m and n are two integers > 
or if m = n = 0, a picture of size (m, n) over S is a function p from {0, 1, ... , m+1} x {0, 1, . . . , n+1} 
into S such that p{0,i) = p{m + l,i) = # for all integers i S {0, 1, . . . , n + 1} and p(i,0) = 
p{i, n+1) = # for all integers i e {0, 1, . . . , m+1} andp(i, j) e S if i ^ {0, m+1} and j ^ {0, n+1}. 
The empty picture is the only picture of size (0, 0) and is denoted by A. Pictures of size (n, 0) or (0, n), 
for n > 0, are not defined. S*'* is the set of pictures over S. A picture language L is a subset of E*'*. 

An a;-picture over S is a function p from uj y. uj into E such that p{i, 0) = p(0, i) = if" for alH > and 
p{i,j) G S for i,j > 0. E"^'"^ is the set of tj-pictures over E. An w-picture language L is a subset of 

2 

For E a finite alphabet we call E'^ the set of functions from to x uj into E. So the set E'^''^ of w-pictures 
over E is a strict subset of E"^ . 



We shall say that, for each integer j > 1, the j*'' row of an tj-picture p € E'^''^ is the infinite word 
p{l,j).p{2,j).p{3,j) . . . over E and the j^^ column of p is the infinite word p{j, l).p{j, 2).p{j, 3) . . . 
over E. 

As usual, one can imagine that, for integers j > k > 1, the j*'^ column of p is on the right of the k^^ 
column of p and that the j*'* row of p is "above" the A;*^ row of p. 

We introduce now tiling systems as in the paper [U. 

A tiUng system is a tuple A={Q, E, A), where Q is a finite set of states, E is a finite alphabet, A C 
(E X Q)^ is a finite set of tiles. 

A Biichi tiling system is a pair {A,F) where A={Q, E, A) is a tiling system and F C Q is the set of 
accepting states. 

A MuUer tiling system is a pair {A, where A={Q, E, A) is a tiling system and .FC 2'^ is the set of 
accepting sets of states. 

Tiles are denoted by [ ^ 3,93) ( 4,94) j ^jj-j, g ^j^^j g. g 

V («l>9l) («2,g2) J 

/ 63 64 \ 

and in general, over an alphabet F, by with Oi G F. 



hi 62 



A combination of tiles is defined by: 



[h b2 J\b[ b'^ J [ {bi,b[) {b2A) ] 
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A run of a tiling system A={Q, S, A) over a (finite) picture p of size (m, n) over S is a mapping p from 
{0, 1, . . . , m + 1} X {0, 1, . . . , n + 1} into Q such that for all (i, j) G {0, 1, . . . , m} x {0, 1, . . . , n} with 

p{i,j) = aij and p{i,j) = qij we have 



A run of a tiling system A={Q, S, A) over an w-picture p e S'^''^ is a mapping p from uj x lo into Q 
such that for all (i, j) G w x w with p{i, j) = aij and p{i,j) = qij we have 



We now recall acceptance of finite or infinite pictures by tiling systems: 

Definition 2.1. Let ^=((5, S, A) be a tihng system, F C Q and J^C 2*3. 

• The picture language recognized by A is the set of pictures p G S*'* such that there is some run p 



• The w-picture language A-recognized (respectively, E-recognized, Biichi-recognized) by {A,F) is 
the set of a;-pictures p G j]'^''^ such that there is some run p of ^ on p and p{v) G F for all (re- 
spectively, for at least one, for infinitely many) v G uj"^. It is denoted by L^{{A,F)) (respectively. 



• The w-picture language Muller-recognized by {A, T) is the set of w-pictures p G E^''^ such that 
there is some run p of ^ on p and Inf{p) G T where Inf{p) is the set of states occurring infinitely 
often in p. It is denoted by L^^{{A,T)). 

Notice that an w-picture language L C S'^ '^ is recognized by a Biichi tiling system if and only if it is 
recognized by a Muller tiling system, [1]. 

We shall denote TS{T,^''^) the class of languages L C S'^ '^ which are recognized by some Biichi (or 
Muller) tiling system. 

We recall now an interesting variation of the above defined acceptance conditions for infinite pictures, 
introduced in [H. This variation uses the diagonal of an a;-picture. 

The diagonal of an w-picture p is the set of vertices Di{p) = {(i, i) \ i ^ uj}. 

The cj-picture language A-recognized (respectively, E-recognized, Biichi-recognized) by {A,F) on the 
diagonal is the set of w-pictures p G S'^''^ such that there is some run p of Aonp and p{v) G F for all 
(respectively, for at least one, for infinitely many) v G Di{p). 

We define similarly the notion of w-picture language Muller-recognized on the diagonal by {A,!F), 
replacing Inf{p) by the set of states Inf{Di{p)) occurring infinitely often on the diagonal of p. 

The following result was stated in |[T1. 





of A on p. 



L^{{A,F)), L^{{A,F))). 



Olivier FinkeU Highly Undecidable Problems about Recognizability by Tiling Systems 



5 



Theorem 2.2. An a;-picture language L C J]'^ '^ is A-recognized (respectively, E-recognized, Biichi- 
recognized, Muller-recognized) by a tiling system if and only if it is A-recognized (respectively, E- 
recognized, Biichi-recognized, Muller-recognized) on the diagonal by a tiling system. 

We wish now to see links with classical notions of tiling of the (quarter of the) plane, see for instance 

El. 

We denote F = S x Q where E is the alphabet of pictures and Q is the set of states of a tiling system 
A={Q, S, A). We consider configurations which are elements of Y'^^'^ . One can imagine that each cell 
of the quarter of the plane contains a letter of the alphabet F. 

Let AC (SxQ)^ = r^bea finite set of tiles. We denote its complement by A^ = — A. A tiling of 
the (quarter of the) plane with A^ as set of forbidden patterns is simply a configuration c € T^'^^ such 
that for all integers i,j G u: 

c(i,j + l) c(i + l,j + l) \ ^ 
c(i,j) c(i + l,j) j 

Then the 6<j-picture language L C J]'^''^ which is A-recognized (respectively, E-recognized, Biichi- 
recognized) on the diagonal by the tiling system {A,F) is simply the set of w-pictures p e s*^'"^ which 
are projections of configurations c G Y^^^ which are tilings of the (quarter of the) plane with A~ as 
set of forbidden patterns such that for all (respectively, for at least one, for infinitely many) i G lu the 
second component of c(i, i) is in F. A similar characterization can be given for the MuUer acceptance 
condition. 

We can also easily state similar characterizations for global recognizability, i.e. not on the diagonal, by 
tiling systems. 

3. The Analytical Hierarchy 

The set of natural numbers is denoted by N and the set of all mappings from N into N will be denoted by 
T. 

We assume the reader to be familiar with the arithmetical hierarchy on subsets of N. We now recall the 
notions of analytical hierarchy and of complete sets for classes of this hierarchy which may be found in 
ED. 

Definition 3.1. Let A;, / > be some integers. <I> is a partial recursive function of k function variables 
and / number variables if there exists z G N such that for any {fi, . . . , fk,xi, . . . ,xi) G J^'' x N', we 
have 

...Jk,xi,...,xi)= r/i'-'-^'=(xi, . . . , xi), 

where the right hand side is the output of the Turing machine with index z and oracles fi, ■ ■ ■ , fk over 
the input (xi, . . . ,xi). For A; > and / = 0, $ is a partial recursive function if, for some z, 

The value z is called the Godel number or index for ^. 
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Definition 3.2. Let A;, Z > be some integers and C x N'. The relation R is said to be a recursive 
relation of k function variables and I number variables if its characteristic function is recursive. 

We now define analytical subsets of N'. 

Definition 3.3. A subset R of N' is analytical if it is recursive or if there exists a recursive set S C 
JP" X W, with m > and n > I, such that 

R = {{xi, ...,Xi) I {QlSi){Q2S2) . . . {Qm+n-lSm+n-l)Sifl, ...,fm,Xi,.. . 

where Qi is either V or 3 for 1 < ? < m + n — Z, and where si , . . . , Sm+n-i are /i , . . . , Z^, xi+i , . . . , x„ 
in some order. 

The expression {QiSi){Q2S2) . . . {Qm+n-iSm+n-i)S{fi, . . . Jm,xi, . . . ,Xn)is called a predicate form 
for R. A quantifier applying over a function variable is of type 1, otherwise it is of type 0. In a predicate 
form the (possibly empty) sequence of quantifiers, indexed by their type, is called the prefix of the form. 
The reduced prefix is the sequence of quantifiers obtained by suppressing the quantifiers of type from 
the prefix. 

The levels of the analytical hierarchy are distinguished by considering the number of alternations in the 
reduced prefix. 

Definition 3.4. For n > 0, a -prefix is one whose reduced prefix begins with 3^ and has n — 1 
alternations of quantifiers. A Sg-prefix is one whose reduced prefix is empty. For n > 0, a 11^^ -prefix is 
one whose reduced prefix begins with and has n — 1 alternations of quantifiers. A HQ-prefix is one 
whose reduced prefix is empty. 

A predicate form is a Sj^ (njj)-form if it has a T,l^ (n^)-prefix. The class of sets in some N' which can 
be expressed in S^-form (respectively, Il^^-form) is denoted by (respectively, n^). 
The class Sq = IIq is the class of arithmetical sets. 

We now recall some well known results about the analytical hierarchy. 

Proposition 3.5. Let i? C for some integer I. Then i? is an analytical set iff there is some integer 
n > such that ReY^l or Re Ul. 

Tlieorem 3.6. For each integer n > 1, 



Transformations of prefixes are often used, following the rules given by the next theorem. 

Theorem 3.7. For any predicate form with the given prefix, an equivalent predicate form with the new 
one can be obtained, following the allowed prefix transformations given below : 



(b) 



(c) 



(a) 




(a) ...3030...^...30..., . . . VV . . . ^ . . . . . . ; 
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(b) . 


..3131...- 


-....31..., 


...vV...- 




(c) . 


..30 


....31..., 


...VO ...^ 


...V^..; 


(d) . 


. . 30V1 . . . - 


...V130..., 


...VO31... 


^ . . . 3IV0 



We can now define the notion of 1 -reduction and of S^-compIete (respectively, n„-complete) sets. No- 
tice that we give the definition for subsets of N but one can easily extend this definition to the case of 
subsets of N' for some integer I. 

Definition 3.8. Given two sets A, i? C N we say A is 1 -reducible to B and write A <i B if there exists 
a total computable injective function f from N to N such that A = f^^[B]. 

Definition 3.9. A set ^ C N is said to be S^-complete (respectively, Il^-complete) iff A is a S^^-set 
(respectively, H^'j-set) and for each S^-set (respectively, Il^-set) S C N it holds that B <i A. 

For each integer n > 1 there exist some S^-complete set En C N. The complement E~ = N — En is a 
n^-complete set. These sets are precisely defined in II2TI or 131. 

4. Borel Hierarchy and Analytic Sets 

We assume now the reader to be familiar with basic notions of topology which may be found in US] [TTl 

There is a natural metric on the set S"^ of infinite words over a finite alphabet S containing at least 
two letters which is called the prefix metric and defined as follows. For u,v E T,^ and n / u let 
6{u, v) = 2~'p'^=f(" ") where /pref(«,j;) is the first integer n such that the (n + I)'** letter of u is different 
from the (n + 1)** letter of v. This metric induces on the usual Cantor topology for which open 
subsets of Ti^ are in the form W.jy , where W C S*. A set L C S"^ is a closed set iff its complement 
S'^ — L is an open set. Define now the Borel Hierarchy of subsets of T,^ : 

Definition 4.1. For a non-null countable ordinal a, the classes and 11^ of the Borel Hierarchy on 
the topological space T,^ are defined as follows: 

5]5 is the class of open subsets of S'^, is the class of closed subsets of S"^, 
and for any countable ordinal a > 2: 

is the class of countable unions of subsets of T,^ in IJ7<o 

is the class of countable intersections of subsets of S'^ in IJ7<a ^7- 

For a countable ordinal a, a subset of T,^ is a Borel set of rank a iff it is in U 11^ but not in 

U7<J5]°unO). 

There are also some subsets of T!^ which are not Borel. Indeed there exists another hierarchy beyond 
the Borel hierarchy, which is called the projective hierarchy and which is obtained from the Borel hier- 
archy by successive applications of operations of projection and complementation. The first level of the 
projective hierarchy is formed by the class of analytic sets and the class of co-analytic sets which are 
complements of analytic sets. In particular the class of Borel subsets of S'^ is strictly included into the 
class Y,\ of analytic sets which are obtained by projection of Borel sets. 
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Definition 4.2. A subset A of Ti^ is in the class of analytic sets iff there exists another finite set Y 
and a Borel subset S of (S x such that rc G A <-> 3y G Y'^ such that (x, y) G B, where (x, y) is 
the infinite word over the alphabet S x y such that (x, y){i) = y(i)) for each integer i>l. 

We now define completeness with regard to reduction by continuous functions. For a countable ordinal 
a > 1, a set F C S*^ is said to be a YP^ (respectively, n[^, Y,\)-complete set iff for any set E C Y'^ (with 
Y a finite alphabet): E G 5]^ (respectively, E G n[^, ii^ G Y\) iff there exists a continuous function 
/ : ^ S*^ such that E = f~^{F). 5]^ (respectively n^)-complete sets, with n an integer > 1, are 
thoroughly characterized in ll22l . 

In particular 71 = (0*.!)'^ is a well known example of Hg-complete subset of {0, l}"^. It is the set of 
w-words over {0, 1} having infinitely many occurrences of the letter 1. Its complement {0, l}"^ — (0*.!)'^ 
is a I]2"Complete subset of {0, l}"^. 

For r a finite alphabet having at least two letters, the set T"^^"^ of functions from lo x uj into F is usually 
equipped with the product topology of the discrete topology on F. This topology may be defined by the 
following distance d. Let x and y in F'^^'^ such that x ^ y, then 

d{x, y) = ^ where 

n = min{p > | 3(i, x(i,j) ^ y{i,j) and i + j = p}. 

Then the topological space F'^^'^ is homeomorphic to the topological space F*^, equipped with the Can- 
tor topology. Borel subsets of F'^^'^ are defined from open subsets as in the case of the topological space 
F"^. Analytic subsets of F"^^"^ are obtained as projections on F"^^"^ of Borel subsets of the product space 

The set S'^ '^ of a;-pictures over S, viewed as a topological subspace of S"^^"^, is easily seen to be home- 
omorphic to the topological space 5]'^^'^, via the mapping tp : S"^'"^ —>■ j]'^^'^ defined by ip{p){i,j) = 
p{i + l,j + 1) for all p G S'^''^ and i, j G u. 

5. Highly Undecidable Problems 

We are now going to study decision problems about recognizable languages of infinite pictures. We 
shall use some results of Castro and Cucker who studied degrees of decision problems for w-languages 
accepted by Turing machines and proved that many of them are highly undecidable, [3J. 
So we now recall the notion of acceptance of infinite words by Turing machines considered by Castro 
and Cucker in |[3l . 

Definition 5.1. A non deterministic Turing machine is a 5-tuple A4 = {Q, S, F, 6, qo), where Q is a 
finite set of states, S is a finite input alphabet, F is a finite tape alphabet satisfying S C F, (70 is the initial 
state, and 5 is a mapping from Q x F to subsets of Q x F x {L, R, S}. A configuration of is a 3-tuple 
{q,a,i), where g G Q, a G F"^ and z G N. An infinite sequence of configurations r = {qi,ai,ji)i>i is 
called a run of on w G S"^ iff: 

(a) {qi,ai,ji) = {qo,w,l),and 
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(b) for each i > 1, {qi,ai,ji) h (q'i+i, 0^+1,^^+1), 

where h is the transition relation of A4 defined as usual. The run r is said to be complete if the limsup 
of the head positions is infinity, i.e. if (Vn > l)(3fc > l){jk > n). The run r is said to be oscillating if 
the liminf of the head positions is bounded, i.e. if {3k > l)(Vn > 1)(3?ti > n){jm = k). 

Definition 5.2. Let M. = (Q, S, F, (5, go) be a non deterministic Turing machine and F (1 Q. The 
a;-language accepted by {M.,F) is the set of w-words o" G S"^ such that there exists a complete non 
oscillating run r = {qi, ai,ji)i>i of 7W on d such that, for all i, qi e F. 

The above acceptance condition is denoted I'-acceptance in lH. Another usual acceptance condition is 
the now called Biichi acceptance condition which is also denoted 2-acceptance in Q. We now recall its 
definition. 

Definition 5.3. Let Ad = (Q, S, F, 5, go) be a non deterministic Turing machine and F Q Q. The uj- 
language Biichi accepted by (A^, F) is the set of w-words a G S*^ such that there exists a complete non 
oscillating run r = (gj, Oj, ji)i>i of on it and infinitely many integers i such that qi G F. 

Recall that Cohen and Gold proved in [4, Theorem 8.6] that one can effectively construct, from a given 
non deterministic Turing machine, another equivalent non deterministic Turing machine, equipped with 
the same kind of acceptance condition, and in which every run is complete non oscillating. Cohen 
and Gold proved also in ||4l Theorem 8.2] that an tij-language is accepted by a non deterministic Turing 
machine with I'-acceptance condition iff it is accepted by a non deterministic Turing machine with Biichi 
acceptance condition. 

From now on, we shall denote Ad^ the non deterministic Turing machine of index z, (accepting words 
over S = {a, h}), equipped with a I'-acceptance condition. In a similar way we shall denote 7^ the 
non deterministic tiling system of index z, (accepting pictures over S = {a, 6}), equipped with a Biichi 
acceptance condition. 

For £7 S S"^ = {a, h}^ we denote a" the w-picture whose first row is the w-word a and whose other 
rows are labelled with the letter a. For an w-language L QT,^ = {a, h}^ we denote L°- the language 
of infinite pictures {cj" [ a € L}. 

We can now recall a result proved in ||9l which will be useful later. 
Lemma 5.4. (IH) 

If L C S'^ is accepted by some Turing machine (in which every run is complete non oscillating) with a 
Biichi acceptance condition, then L°- is Biichi recognizable by a finite tiling system. 

Proof. Let L C S'^ be an w-language accepted by some Turing machine M. = (Q, S, F, 5, go) with a 
Biichi acceptance condition, where F C Q is the set of accepting states. 

We assume that the Turing machine has a single semi-infinite tape, with one reading head which may 
also write on the tape. 

Cohen and Gold proved that one can consider only such a restricted model of Turing machines El. 
An instantaneous configuration of M. is given by an infinite word u.q.v where u G F*, q G Q, v & F^, 
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and the first letter of v is the one scanned by the head of M.. 

The initial configuration of M reading the infinite word a G S'^ is q^.a. 

A computation of M. reading cr G S'^ is an infinite sequence of configurations a^^ai, a2-, ■■■ ,ai, .. . , 
where = q^-cy is the initial configuration and for all integers i > 0, = Ui.qi.Vi is the {i + l)*'^ 
configuration. 

The computation is successful if and only if there exists a final state qf £ F and infinitely many integers 
i such that qi = qj. 

Using a similar reasoning as in the classical proof of the undecidability of the emptiness problem for 
recognizable languages of finite pictures, llTi ;. p. 34], we can define a set of tiles A in such a way that for 
(7 G S*^, a run p of the tiling system T={T,, F U Q, A, F) over the infinite picture a" satifies: 

for each integer i >0 p(0, i)-p{l, i)-p{2, i) . . . = ai = Ui.qi.Vi 

i.e. p(0, i)-p{'^, i) ... is the (i + 1)*^ configuration of A4 reading the a;-word a G S'^. 

Thus the Biichi tiling system {T,F) recognizes the language L'^. □ 

Notice that the above cited constructions of f4] and of the proof of Lemma 1541 are effective and that they 
can be achieved in an injective way. This is expressed by the following lemma. 

Lemma 5.5. There is an injective computable function K from N into N satisfying the following prop- 
erty. 

If Aiz is the non deterministic Turing machine (equipped with a I'-acceptance condition) of index z, and 
if 7^(2) is the tiling system (equipped with a Biichi acceptance condition) of index K{z), then 

Recall that Castro and Cucker proved in lO that the non-emptiness problem and the infiniteness problem 
for cj-languages of Turing machines are both S J -complete. We can now easily infer from Lemma [531 a 
similar result for recognizable languages of infinite pictures. 

Theorem 5.6. The non-emptiness problem and the infiniteness problem for Biichi-recognizable lan- 
guages of infinite pictures are Sj^ -complete, i.e. : 

1. {z G N [ L^{%) / 0} is S^-complete. 

2. {z G N [ L^{%) is infinite } is S^-complete. 

Proof. We first show that these two decision problems are in the class T\. 

Notice first that, using a recursive bijection 6 : (N — {0})^ ^ N — {0}, one can associate to each i^-word 
(7 G S'^ a unique a;-picture p" G T!^'^ which is simply defined by p^{i,j) = a{b{i,j)) for all integers 
i,3 > 1- 

On the other hand a run of a tiling system A-{Q, S, A) over an w-picture p G S'^''^ is a mapping p from 
uj X uj into Q, i.e. an element of Q^^^. Using again a recursive bijection between (N)^ and N, we can 
identify a run p with an element of Q*^ and finally with a coding of this element over the alphabet {0, 1}. 
So the run p can be identified with its code p G {0, 1}'^. 
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Assume now that the tiUng system A={Q, S, A) is equipped with a set of accepting states F C Q. It 
is then easy to see that for cr € S"^ and p G {0, 1}'^, "p is a Biichi accepting run of {A, F) over the 
w-picture p'^" can be expressed by an arithmetical formula, see also |T, Section 2.4]. 

We can now express "L^(T^) / 0" by "3o- e T,^ 3p e {0, 1}'^ [ p is a Buchi accepting run of Tz over 
the oj-picture p'^ ]" which is a S| -formula. 

In order to show that "L^{Tz) is infinite " can be also expressed by a S}-formula, we shall use again the 
bijection 6 : (N - {O})^ ^ N - {0}. 

We can consider an infinite word cr € S"^ as a countably infinite family of infinite words over S : the 
family of w-words (fjj) such that for each i > 1, cTj is defined by o-j(j) = a{b{i,j)) for each j > 1. In a 
similar manner an cj-word p G {0, l}"^ can be considered as a countably infinite family of infinite words 
{pi) defined, for each i > 1, by Pi{j) = p{b{i,j)) for each j > 1. 

We can now express ''L^{Tz) is infinite " by the formula "3cj € S"^ 3p G {0, 1}'^ [ ( all oj-words cjj 
are distinct ) and (for each integer i > 1, /9j is a Biichi accepting run of Tz over the tj-picture p"^) ]" . 
This is a $]}-formula because "all w-words cjj are distinct" can be expressed by the arithmetical formula: 

"(Vj>A;>l)(3i>l)a,(i)/afc(i)". 

Using the reduction K given by Lemma [53] we can easily see that L{M.z) is empty (respectively, infinite) 
if and only if L^{Tx[z)) = L{M.zY empty (respectively, infinite). This proves that 

{z G N I L{Mz) / 0} <i {z G N I L^{Tz) + 0} 

{z G N [ L{M-^ is infinite } <i {z G N | L^(T^) is infinite } 

and then the completeness result follows from the -completeness of the non-emptiness problem and 
of the infiniteness problem for cj-languages of Turing machines. □ 

On the other hand it is easy to see that the language S'^''^ — (S'^)" of cj-pictures is Biichi recognizable. 
But the class T5(S'^''^) is closed under finite union, so we get the following result. 

Lemma 5.7. If L C S'^ is accepted by some Turing machine with a Biichi acceptance condition, then 
jji y pi^,<^ _ {j^^Y\ is Biichi recognizable by a finite tihng system. 

Notice that the constructions are effective and that they can be achieved in an injective way, so we can 
now state the following lemma, asserting the existence of a computable function H which will be often 
used in the sequel. 

Lemma 5.8. There is an injective computable function K from N into N satisfying the following prop- 
erty. 

If M.Z is the non deterministic Turing machine (equipped with a I'-acceptance condition) of index z, and 
if Th{z) is the tiling system (equipped with a Biichi acceptance condition) of index H{z), then 

LiMzT U P"'" - = L^'iTH^z)) 
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We can now prove that the universality problem for Biichi-recognizable languages of infinite pictures is 
highly undecidable and give its exact degree. 

Theorem 5.9. The universality problem for Biichi-recognizable languages of infinite pictures is 112- 
complete, i.e. : {2 G N | L^{%) = S'^''^} is Il^-complete. 

Proof. We first check that the set e N [ L^{%) = S'^''^} is in the class 11^. We can write that 
L^{%) = S'^-'^if andonly if "Vcr £T.'^3pe {0,1}'^ ( pis aBuchi-accepting run of overp'^ )". The 
two quantifiers of type 1 are followed by an arithmetical formula. Thus the set {z € N | L^{Tz) = S'^''^} 
is in the class 

In order to prove completeness we use the corresponding result for Turing machines proved in ||3l : the 
set {z € N I L{A4z) = is Ilg-complete. Consider now the injective computable function H 
from N into N given in Lemma [5^ It is easy to see that for any Turing machine it holds that 

L{Mz) = S'^ if and only if L{MzT U [S'^'^ - i^'^)"] = L^{Th{z)) = S'^''^- This proves that 
{z e N I L{Mz) = S"^} <i G N I L^(T^) = S'^''^}, thus this latter set is H^-complete. □ 

We now consider the inclusion and the equivalence problems for Biichi-recognizable languages of infinite 
pictures. 

Theorem 5.10. The inclusion and the equivalence problems for Biichi-recognizable languages of infinite 
pictures are Ilg-complete, i.e. : 

1. {{y,z) G N2 I L^{Ty) C L^{%)} is n^-complete. 

2. {(y, z) G N2 j L^{Ty) = L^{%)} is H^-complete. 

Proof. We first prove that the set {(y, z) G | L^{Ty) C L^{%)} is a Hg-set. It suffices to remark 
that ''L^(Ty) C L^{%)" can be expressed by the H^-formula : "V o" G T.'^ Mp G {0, 1}'^ 3p' G {0, l}"' 
[if (p is a Buchi accepting run of Ty over p'^), then {p' is a Biichi accepting run of 7^ over p")\"- 
Then the set {(y, z) G | L^iTy) = L^{%)} which is the intersection of the two sets {(y, z) G | 
L^iTy) C L^{T,)} and {(y, z) G | L^{%) C L^{Ty)] is also a n|-set. 

On the other hand it is easy to check that for all integers y,z, it holds that L{M.y) C L{M.z) iff 
L^'iTH^y)) C L^(Tj^(,)) and that L{My) = L{Mz) iff L^(r^(^)) = L^{Th^z)). Thus using the 
reduction H we see that 

{(y,z) G I L{My) C L{Mz)} <i {(y,z) G | L^(r^) C L^{%)} 

{(y, z) G I L{My) = L{Mz)} <i {(y, z) G | L^(r,) = L^(T,)} 

The Ilg-completeness follows then from the n2-completeness of the inclusion and the equivalence prob- 
lems for w-languages of Turing machines proved in [3J. □ 

We are going to consider now the decision problems studied in Q. Using topological arguments, we 
gave in ||9J the answer to two questions raised in |T|, showing that it is undecidable whether a Biichi 
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recognizable language of infinite pictures is E-recognizable (respectively, A-recognizable). We are going 
to show that these problems are actually -complete, using again some topological arguments. 

Theorem 5.11. The problem to determine whether a given Buchi-recognizable language of infinite pic- 
tures is E-recognizable (respectively, A-recognizable) is Ilg-complete, i.e. : 

is E-recognizable } is Ilg-complete. 

2. {z G N I L^{Tz) is A-recognizable } is Ilg-complete. 

Proof. We first prove that the set {z G N | L^{Tz) is E-recognizable } is a Ilg-set. The sentence 
"L^{Tz) is E-recognizable" can be expressed by "By L^{Tz) = L^{Ty)". The assertion ''L^{Tz) = 
L^{Ty)" can be expressed by a Ilg-formula in a very similar manner as "L^{Tz) = L^{Ty)" was (see 
the proof of Theorem 15.101 ). because for o" S S'^ and p € {0, l}"^ the sentence "(p is a E-accepting run 
of Tz over the w-picture p^)" can be expressed by an arithmetical formula. Moreover the quantifier 3y is 
of type thus ''L^{Tz) is E-recognizable" can be expressed by a Ilg-formula. 

We prove in a very similar manner that "L^{Tz) is A-recognizable" can be expressed by a Hg-formula. 
Details are here left to the reader. 

We now prove the completeness part of the result. We first define a simple operation over w-languages. 
For two words x,x' € T,^ the i^-word x ® x' is just the shuffle of the two a;- words x and x' which is 
simply defined by : for every integer n > 1 {x®x') (2n — 1) = x(n) and {x ® x') (2n) = x'{n). For two 
w-languages L, V C S'^, the tj-language L (g) L' is defined by L (g) L' = {x (8> x' | x € L and x' G L'}. 

We shall use the following construction. We know that there is a simple example of S]^ -complete set 
L C S'^ accepted by a 1-counter automaton, hence by a Turing machine with 1' acceptance condition, 
see im. Then it is easy to define an injective computable function 6 from N into N such that, for every 
integer z G N, it holds that L{Me{z)) = {L ® T}^) U (S"^ ^ L{Mz)). 

We are going to use now the reduction H already considered above. We have seen that 

L{Mz) = S'^ if and only if L{Th(z)) = S"""" 

and we can easily see that 

L{Me^z)) = if and only if L{Mz) = S"^ 

because L / S'^. 

The reduction o ^ is an injective computable function from N into N. 
We consider now two cases. 

First case. L{Mz) = S'^. Then L{Me(z)) = S'^ and L^{THoe{z)) = In particular L^{rHoe{z)) 
is E-recognized (respectively, A-recognized) by a tiling system. 

Second case. L{Mz) / S'^. Then there is an L<j-word x G S'^ such that x ^ L{Mz). But L{Mq(^z)) = 
{L (g) S'^) U (S'^ (g) L{Mz)) thus {(J G S'^ [ a (g) x G L{M0(z))} = L is & Sj-complete set. The 
function ipx : cr ^ o" (g x is continuous. This implies that L{M.qi^z)) riot ^ Borel set because otherwise 
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L = {(T^Ti^\a®x^ L{M.g{^z))} = "^^x^iLiMgi^z))) would be also Borel as the inverse image of a 
Borel set by a continuous function fT5l . 

Then it is easy to see that L^{THoe{z)) = ^(-^^61(2))" U [S'^''^ - (S"^)"] is not a Borel set. But it was 
proved in [9, Lemma 5.2] that every E-recognized language of infinite pictures is a S2-set and in |9l 
Lemma 5.3] that every A-recognized language of infinite pictures is a closed set. 
Thus in that case the w-picture language {THoe{z)) is neither E-recognizable nor A-recognizable. 

Finally, using the reduction H o 9,we have proved that : 

{z G N I L{Mz) = S""} <i {2 e N I L^{%) is E-recognizable } 

{z G N I L{Mz) = S"^} <i G N I L^{%) is A-recognizable } 
and this ends the proof. □ 

As in in we are going to infer from the proof of (high) undecidability of E-recognizability (respectively, 
A-recognizability) some other (high) undecidability results. 

It was proved in 13 that for any Borel class 5]° or n[J, it is undecidable whether a given Biichi- 
recognizable language of oj-pictures is in Xl^ (respectively, is in 11°, is a Borel set). We can deduce 
from the above proof that the topological complexity of recognizable languages of infinite pictures is in 
fact highly undecidable. 

Theorem 5.12. Let a be a non-null countable ordinal. Then 

1. G N I L^(T^) is in the Borel class 5]° } is Il^-hard. 

2. {z G N I L^(T^) is in the Borel class 11° } is 11^ -hard. 

3. {z G N I L^(T^) is a Borel set } is n|-hard. 

Proof. We can use the same reduction H o 9 as in the proof of Theorem 15.111 We have seen that there 
are two cases. 

First case. L{Mz) = H'^. Then L{Mg(^,)) = S"^ andL^(T^„0(^)) = S'^''^. In particular L^(Tj;^„0(^)) = 
j^w,uj open and closed subset of H'^''^ and it belongs to all Borel classes and 11° . 
Second case. L{Aiz) ^ S'^. Then we have seen that {Tu^q^^-^) is not a Borel set. 
Finally, using the reduction H o 9, the result follows from the Ilg -completeness of the universality prob- 
lem for cj-languages of Turing machines. □ 

We now come to the complementability problem. The class of Buchi-recognizable languages of infinite 
pictures is not closed under complement [ 1 ]. Thus the question naturally arises: "can we decide whether 
the complement of a Buchi-recognizable language of infinite pictures is Biichi-recognizable?". It has 
been proved in |i9J that this problem is undecidable. We are going to prove that it is in fact Ilg-complete. 

Another classical problem is the determinizability problem: "can we decide whether a given recogniz- 
able language of infinite pictures is recognized by a deterministic tiling system?". Again this problem 
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has been proved to be undecidable in ||9l and we shall prove it is in fact -complete. 
Recall that a tiling system is called deterministic if on any picture it allows at most one tile covering 
the origin, the state assigned to position (i + 1, j + 1) is uniquely determined by the states at positions 
{i + 1, j), (i, j + 1) and the states at the border positions (0, j + 1) and {i + 1, 0) are determined 
by the state (0, j), respectively (i, 0), Hj. 

As remarked in [H, the hierarchy proofs of the classical Landweber hierarchy defined using determin- 
istic cj-automata "carry over without essential changes to pictures". In particular it is easy to see that 
a language of w-pictures which is Biichi-recognized by a deterministic tiling system is a Ilg-set and 
that a language of w-pictures which is Muller-recognized by a deterministic tiling system is a boolean 
combination of n2-sets, hence a Ag-set. 

We can now state the following results. 

Theorem 5.13. The determinizability problem and the complementability problem for Biichi-recognizable 
languages of infinite pictures are Ilg-complete, i.e. : 

1. {z E N I L^{Tz) is Biichi-recognizable by a deterministic tiling system} is n2-complete. 

2. {z G N [ L^{%) isMuller -recognizable by a deterministic tiling system } is n2-complete. 

3. {z e N [ 3y S"^'"^ - L^{%) = L^{Ty)} is -complete. 

Proof. It is easy to see that the set D of indices of deterministic tiling systems equipped with a Biichi 
acceptance condition is recursive. The formula 3y G D L^{Tz) = L^{Ty) can be written : "3y[y G 
D and L^{Tz) = L^{Ty)]" and it can be expressed by a 112 -formula because the quantifier 3y is of type 
and "L^iTz) = L^{Ty)" can be expressed by a Il^-formula. Thus the set {z G N | 3?/ € L^iTz) = 
L^{Ty)} is in the class U^. 

The case of deterministic tiling systems with Muller acceptance condition is very similar. Details are 
here left to the reader. 

On the other hand "S"' '^ - L^(T^) = L^{Ty)" can be expressed by a H^-formula so " 3y S'^'^ - 
L^{Tz) = L^{Ty)" can be expressed by a Ilg-formula because the quantifier 3y is of type 0. Thus the 

set {z G N I 3y S"^'"^ - L^(r^) = L^{Ty)] is in the class H^. 

To prove completeness, we use the same reduction i7 o 6* as in the proof of Theorem 15.1 II We have seen 
that there are two cases. 

First case. L{Mz) = S"^ and then L^{THoe{z)) = S'^''^- In particular L^{THoe{z)) = 5^'^''^ is accepted 
by a Biichi deterministic tiling system and also by a Muller deterministic tiling system. Morever its 
complement is empty so it is Biichi (or Muller) recognized by a tiling system. 

Second case. L{Mz) ^ S'^. Then we have seen that {Tuoeiz)) is not a Borel set. Thus in that 
case L^{THoe{z)) cannot be accepted by any deterministic tiling system with Biichi or Muller accep- 
tance condition. Moreover its complement E'^'" — {THoe{z)) is not a 5]J-subset of E'^''^ because 
otherwise {TfjaO^z)) would be in Aj^ = Sj^ n Il\ which is the class of Borel sets by Suslin's Theo- 
rem. Thus S'^''^ — (Tfj^gf^z)) cannot be Biichi-recognizable because it is not a 5]J-subset of S'^''^ and 
r5(E'^'^) C si C Sj, see ffl. 

Finally, using the reduction H o 9, the result follows from the Ilg -completeness of the universality prob- 
lem for w-languages of Turing machines. □ 



16 



Olivier Finkel/ Highly Undecidable Problems about Recognizability by Tiling Systems 



We gave in [91 a solution to a question of lU, showing that all languages of infinite pictures which are 
accepted row by row by Biichi or Choueka automata reading words of length cu^ are Biichi recognized 
by a finite tiling system, but the converse is not true. Then we showed that one cannot decide whether 
a given Biichi-recognizable language of infinite pictures is accepted row by row by a Biichi or Choueka 
automaton reading words of length uP. We are going to show now that this decision problem is actually 
also -complete. 

Recall that an cj^-word x over the alphabet S is a sequence of length cj^ of letters in S. It is denoted by 

(x(i))o<.j<a;2 = x{Q) .x{\) .x{2) . . . x{i) . . . , where for alH, < i < w^, x{i) is a letter in S. 

The set of a;^-words over S is denoted by S"^^. An w^-language over S is a subset of T,'^^ . 

To define a notion of acceptance row by row of an w-picture we first associate, to an infinite picture 

p € S'^''^, an w^-word p G S'^ which is defined by p{uj.n + m) = p{m + 1, re + 1) for all integers 

re, m > 0. 

This can be extended to languages of infinite pictures: for L C S'^''^ we denote L = {p \ p £ L} so L is 
an w^-language over S. 

We refer the reader to |9| for a precise definition of generalized Biichi automaton acceptings words of 
ordinal length. We recall now the following definition. 

Definition 5.14. A language of infinite pictures L C S'^''^ is accepted row by row by an ordinal Biichi 
automaton if and only if the w^-language L is regular, i.e. is accepted by an ordinal Biichi automaton. 
We denote BA{T,'^''^) the set of languages L G S'^-'^ such that L is regular. 

We can now state the following result. 

Theorem 5.15. The problem to determine whether a given Biichi-recognizable language of infinite pic- 
tures is accepted row by row by an ordinal Biichi automaton, is Ilg-complete, i.e. : 

is regular } is -complete. 

Proof. Recall that, for each language of infinite pictures which is accepted row by row by a Biichi 
automaton reading words of length w^, it was constructed in [9] a Muller tiling system accepting it. 
Then, using [1, Theorem 1], one can effectively construct a Biichi tiling system accepting the same 
language. The set Tr of indices of Biichi tiling systems constructed from the proof of ||9j Theorem 4.1] 
and 01 Theorem 1] is easily seen to be recursive. Notice that Tr does not contain all indices of Biichi 
tiling systems accepting languages in BA{T,'^''^). But for each language L in BA{Y1'^''^) there is an index 
z €Tr such that L = L^{%). 

We can then express "L^{%) is regular " by the formula "3y[( y ^Tr) and L'^iT^) = L^{Ty)". This 
is a Ilg-formula because "L^{Tz) = L^{Ty)" can be expressed by a -formula quantifier 3y is 

of type 0. 

To prove completeness we can use the same reduction H o 9 asm the proof of Theorem 15.111 We have 
seen that there are two cases. 

First case. L{Mz) = T,'^ and then {THoe{z)) = In particular, L^(Tj:/oe(2)) = S"^'"^ is accepted 
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row by row by an ordinal Biichi automaton. 

Second case. L{Aiz) 7^ S"^. Then we have seen that {T^^q^^^-^) is not a Borel set. Thus in that case 
{THoe{z)) is not a regular w^-language because otherwise {Tho0{z)) would be a Borel set (of rank 
smaller than or equal to 5), see f9^. Proposition 4.2]. 

Finally, using the reduction H o 6, the completeness result follows from the Ilg-completeness of the 
universality problem for w-languages of Turing machines. 

□ 

6. Concluding Remarks 

We have given in this paper the exact degree of numerous natural decision problems for recognizable 
languages of infinite pictures. This way we have given examples of natural highly undecidable problems 
which are complete at the first or at the second level of the analytical hierarchy. Notice that many 
examples of E} -complete problems are already known, such as the recurring tiling problem, see for 
instance (T2[ [131 [T4|| . But it seems that very few natural problems, except some problems about u- 
languages of Turing machines, are known to be -complete. of motivation of Castro and 
Cucker in [3 | was actually to "give natural complete problems for the lowest levels of the analytical 
hierarchy which constitute an analog of the classical complete problems given in recursion theory for the 
arithmetical hierarchy". So we have added in this paper many new examples which complete the work 
of |i3j1. 

Notice that in another paper we have also given many natural -complete problems about the infinite 
behaviour of very simple finite machines like 1-counter automata or 2-tape automata, ifTOl . 

We hope also that our results could be useful in other connected areas, for instance in the study of the 
infinite behaviour of cellular automata, Il25ll6l. 
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